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Abstract 


Automatic restructurers do not completely extract all the parallelism in sequential 
programs. As a result, Interactive parallelizers are considered an attractive alter- 
native. In Interactive tools, the dependence updates in response to changes should 
be quick. However, computing value based dependences is a time consuming proce- 
dure. Changes in a program typically affect a small portion of dependences and leave 
larger part unaffected. The resulting dependences can be got faster than exhaustive 
analysis if only the affected portion is recomputed. Incremental analyzers modify 
only the affected parts of the solution, and hence can quickly reflect the affect of 
the changes on the solutions. In this work we present a framework for incremental 
dependence analysis for value based dependences. 

We illustrate how the dependences change as a result of increase or decrease 
in the values generated at any point in a program. Using these techniques, w'e 
show how the incremental analysis can be done in cases of insertion or deletion of 
assignment statements and loops. We give algorithms for incremental analysis for 
these cases. We will also present the speedups obtained by implementations based 
on the algorithms given. 
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Chapter 1 
Introduction 


Von Neumann paradigm of computing advocated sequential semantic of execution of 
programs. As a result, all the programs written in earlier days used only sequential 
constructs. I'he growing need for computing power and the progress in technology 
resulted in a shift in computing paradigm and development of Vector and Parallel 
computers. However, the serial code accumulated over the years cannot exploit the 
power of these computers. 

Re-coding all sequential code using parallel constructs in not economical. Smart 
compilers that can identify parallelism in the programs written with sequential con- 
structs were developed. These are called “Parallelizing Compilers” or “Restructuring 
Compilers”. These ctnnpilers re-order the execution sequence of the statements to 
execute some of them in parallel. 

Data dependence analysis is an important procedure in identifying parallelism 
in a sequential code. It identifies the flow of values between the statements. This 
information is used to check the feasibility of the re-ordering transformations, such 
that the semantics are maintained. However, computing dependences is a costly 
process. It is known to be NP-Complete [11]. 

The existing restructuring compilers cannot extract all the parallelism in a se- 
quential program. As a result, interactive parallelizing tools are considered an at- 
tractive alternative. These tools can be of multipurpose use and can be used for 
interactive optimizing of the parallel programs also. In such tools, often the users 
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make small modifications to the programs. Under the existing framework for de- 
pendence analysis, every time a program is modified, exhaustive reanalysis has to 
be carried out to restructure the program. Often the changes in the program may 
be limited to a small portion, and may not affect a major part of the value based 
dependences. Therefore, modifying only the affected part of the dependences can 
result in a faster computation of the dependences. 

1.1 The Problem 

The proposed problenr to be tackled is, 

• to identify the dependences affected as a result of modifications to the program 
and 

• to compute the new dependences, as well as update the affected dependences 
to reflect the effect of the modifications.” 


1.2 Work Done 

In this work, we have propo.sed a framework for incremental updating of value 
based dependences. We show how the dependences are affected on arbitrary in- 
crease/decrease in the values generated and the values read. Using these techniques, 
we have developed algorithms for insertion/deletion of assignment statements and 
loops. However, the techniques are general enough to be extended for other form of 
modifications also. 


1.3 Related Work 

Smith, Applebe and Stirewalt [4] have developed a program assistance tool (PAT) 
for incrementally updating of memory based dependence information. However, in 
their method the global information remains static as sequential dependence graphs 
are not modified. This restricts the incremental updating only to specific locations 
of the code. 
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1.4 Organization 

The organization of the report is as follows : 

Chapter 2 Brief introduction to the basic concepts of value based dependence and 
its representations. 

Chapter 3 Discusses the incremental analysis of dependences for increase and de- 
crease in the values generated. The incremental analysis for insertion/deletion 
of assignment statements and for loops is also discussed in this chapter. 

Chapter 4 Gives the algorithm implemented. 

Chapter 5 Gives the results of implementation. 

Chapter 6 Gives the conclusions and discusses the future scope. 

Appendix A Gives the exhaustive dependence analysis algorithm, “Lazy Array 
Data-Flow Dependence Analysis”. 
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Chapter 2 


Basic Concepts 


In this chapter we briefly introduce some of the basic concepts of dependence and 
the representations used for dependence. The notations used in this work are given 
in figure 1. 

2.1 Dependence 


There is a data dependence from reference Si.x to statement Sj.y if in some execution 
sequence, there exist 54*i,5) and 5 j[j2,s], instances of Si and S 2 respectively such 
that 


• both and Sj.yfiai'S] access a location, say M 

• 5i.T{ii,s] or 5j.y[j2,s] is a write to a location M 

• 5i{ti,s] is executed before 5j[i2, 5 ] 

If there is a dependence from Si.x to Sj.y, Si.x is called source of the dependence 
and Sj.y is called sink of the dependence. Depending on whether Si.x and Sj.y is 
read or write, Kuck and others[5] classified dependences as : 

Flow or Tlrue Dependence : In this dependence, Si.x is a write to the location 
M and Sj.y is a read from M. Flow dependence is denoted by 6 and dependence 
between statements is written as Si.x 6 Sj.y. 
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DepRtls,Syk / V 


I'hr Knfry of tlu' program 
Spccilir statenionts in a program 

riu* univorsal sot - consisting all assignment statements. 

Array or the scalar variable referrtxl in reference Si-k. 
riio iteration vectors that represent specific set of values 
of loop variables. 

i he sub veff»)r of w consisting of <-omponents u\, u \+\,. . . , Wj. 

.Specili<- references in the statement 5';, in order from left to right. The write 
in an assignment is always 5,.l. 

The set of iteration vectors for which statement Si is executed, given set of 
symbolic constants s. 

Specific instance of statement Si executed for iteration vector ii. 
iiefines tlie order on the two operands, eg., 

•S -C Sj implies Si occurs before Sj lexically, 

implies statement instance is executed before 

the instance 5j(h2,.s). 

The set (if <h*pendence relations for reference 5j.x, such that Sj.x is the sink. 
Dependence relation representing dependence from Si.l to Sj.x 
Itestrict the <ioniain of relation DepRe.ls.Sj.k to the vector V. 

(x y) tI)rpRrls,ii,.k \ S (x y) tDepRels,s,.k A x e S 
H<‘stric.t the range of relation DtpRels.Syk to the vector V. 

(x y) (Dt’pRtls..'i,.k I {x-* y) eDepRels,s,.k A y e S 


Figure 1: Notations 
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For ii = 1, 5 
For i 2 = 1,4 

Si : = B{ti,t2) 

^2= = >1(»1,»2) + B(»1,*2) 

$3 : -^(*11*2 + 1) = 2 
Ejidfor 
Kndfor 


Figure 2 : Example code 

Output Dependence : In this dependence, both 5 ,.x and Sj.y are write to the 
location M. Out piit dopcn<lence is denoted by 6° and the dependence between 
the statejinmts is written as S,.t 8“ Sj.y. 

Anti Dependence : In this dependence, 5 ,.x is a read from the location M and 
Sj.y is a write to location M. The dependence is denoted by 8 and the depen- 
dence between the statements is written as Si.x8Sj.y. 

8’ rt'presents dependence without specifying the type. 

In figure 2 , tlu* reference A{ixJi) in statement S2 reads from the memory loca- 
tions that are written in statement 5 ’i, in the same iterations of h and *2- So there 
is a flow <lep<‘n<len<<‘s from Si to S^. 

'file refereme HiiiJi + U ii> stati'inent S2 writes to the location that was read 
by n'ference li(ii.ii) in S2 in the previous iterations of ?2- So there is an anti 
dependence from S^ to 

The reference /t(fi,J2) in the statement S3 writes to the location written by 
A(?i,T2 + 1 ) in the previous iteration of ?2- So there is an output dependence from 
S3 to Si. 

'Fhe output and anti dependences are a result of reuse of the memory locations. 
They can be remov<'d by differenl transformations [ 9 ]. Flow dependence is a result of 
reuse of the values defined at the source by the sink. For this reason flow dependence 
is also called as true dependence. 
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2.2 Representations 


1 h<' dcpoiidpiiccs arc traditionally represented by distance vectors and direction 
tKciors. 

2.2.1 Distance Vector 

The distance vector [9] for a dependence 5..x[u>,5] Sj.y[r,s], is an n-tuple 
I) =(/>», 1)2 IK) where, 

• 5, and 5'^ are rov<‘red by n loops and 

• I), ~ w, - r,. 

2.2.2 Direction Vector 

The direction vector [6] for a dependence 5,-.x[tt’,s] — ^ 5j.y[r,s], is an n-tuple 
d = (dj, d 2 s„) where, 

• v*?, and Sj are co vert'd by n loops and 

• di < {<,<,>,>,=,*} such that the logical relation te, d,- r,- holds. 

Direction vectors art' more coarse form of representing dependence than distance 
vectors. The dirt'ction vector d can be obtained from distance vector D, w'here 

‘ >' if Di > 0 
‘ =' if Di = 0 
‘ <' if Di < 0 
‘ <' if Di < 0 
‘ >' if Di > 0 

‘ if any of the above relations 
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2.3 Loop Carried and Loop Independent depen- 
dence 

Dependences can also be classified as “Loop Carried" dependence or “Loop Inde- 
pendent” dependence. 

If a dependence is a Loop Independent dependence all the elements in the direc- 
tion vector are ‘=’. If a dependence is loop independent dependence the last common 
loop between the source and sink say, /„ is called as carrier of the dependence. 

If a dep<‘ndence is a Loop Carried dependence at least one element in the direction 
vector is not ‘=’. A loop /. is called carrier of the loop carried dependence if, the 
first non el<‘iin*nt in the direction vector is + 1** element. 

2.4 Restricted Domain For Dependence Calcula- 
tion 

The problem of finding dependence in general is undecidable. In practice it is enough 
to consider dependences that are affine, as most of the references are of this category. 
The dependence problem is affine [8] if, 

• All the loop bounds are integers or integer linear functions of more outwardly 
nested loop variabh's and 

• The array reference functions arc integer linear functions of the loop variables, 
or symbolic constants. 

Most of tlie analyzers ignore control flow in calculating the dependences [8], or 
restrict the conditions in the control statements also to be affine. In this restricted 
domain, the problem of finding dependence is NP-oomplete [11]. 

2.5 Value Based Dependence 

Dependences define constraints on the order of execution of the statements. After 
restructuring, the resulting program must maintain these constraints. The definition 
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For 1 = 1,5 


For t = 1, 5 

A{«) = ... 

5 ,: 


/ 4 (t) = A{i- 1 ) 


Endfor 

Endfor 


For i = 1, 5 


52: 

A(t) = A(: - 1 ) 
Endfor 

(a) 


(b) 


Figure 3: Example code 

alxAe say th<“ie is a <l<*j)<*iid<*nce hetweon two references if they access same memory 
location. I his definition is too \v<*ak and introduces false dependences which may 
not allow transformations that could have been applied otherwise. According to the 
definitions given above the dependences in the program given in figure 3 are, 

• Output dependence from A(?) in Si to A{r) in 82 - 

• Output dependence from / 1 ( 2 ) in S 2 to A{i) in Si. 

• Flow dependence from A{i - 1) in S 2 to A{i) in statement Si. 

1 hough the program in figure 3 can be transformed to the program in figure 3(b) the 
flow depen<l<‘nc<' from S\ to S 2 does not allow the transformation. This is because 
th<‘ ix'structuring is restricted by th<‘ flow of values betw'ecn the references rather 
tlian reference to the saint' memory location as assumed by the definition above. It 
is called hUmory Based Depcndtncc. 

Feautrier (3] restricted the definition of dependence to represent the true flow of 
values, and called this form of dependence as Value Based Dependence. According 
to his definition there is a value based dependence from reference Si.x to reference 
Sj.y if there arc and 5j[?2,5]5 instances of Si and Sj respectively, such that 

• at least one of the references Si.x or Sj.y is write 

• statement instance 5, [ 11 , 5 ] is executed before the statement instance 5j[i2,5] 

• the references S{.x and Sj.y refer to the same memory location M in instances 
ii'.-.xfijjs] and Sj.j/[i 2 ,s] and 
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• there is no overwriting of value in the memory location M between the instances 

and 5j[j2,a]. 

According to the above definition the value based dependences in the program given 
in figure 3 are 

• Output dependence from A(j) in Si to A(t) in S^. 

• Flow dependence from A(i - 1) in S 2 to A(t) in 82 - 

Now the program in figure 3 can be transformed to the program given in figure 3(b). 

2.6 Dependence Relations 

The direction vectors and the distance vectors are powerful enough to represent the 
memory based dependences and the transformations used traditionally. However, 
value based dependences as well as some of new transformations such as array ex- 
pansion (2] and array privatization [1] need more powerful representations. In these 
transformations, given a reference and a set of iterations, it should be possible to 
calculate the source and its iterations involved in dependence. Neither of the above 
representations can identify the exact iterations involved for all the cases. The direc- 
tion vectors do not identify the exact iterations of dependence except for direction 
‘=’. 'I'he distance vectors can identify the iterations only if the distance between the 
source and sink iterations is constant. Recent research on value based dependence 
and the representations, resulted in Quasi-Affine Selection Tree(quast) [3] also called 
Last Write Tree and Dependence Relations [10]. Given an iteration at the sink, the 
source and the instance of the source can be found in these functions. Hence, they 
are called as source Junctions [3]. 

Dependence relation is a form of source functions. It is a mapping from the 
iteration space of the sink to the iteration space of the source. The mapping is 
specified by a set of linear constraints on loop indices, subscript functions and the 
symbolic constants at the source and the sink. 

For example, in figure 3, the flow dependence from the read A{i) in statement 
S 2 to the write A{i) in 8 % is represented in dependence relations as. 
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“S-H*!! ^2-2[*2] I 2 < t2 < 5 A *1 = »2 - 1 (1) 

In this report, the dependences are represented using dependence relations. A 
dependence relation consists of two parts, viz., 

1. The reference involved in the dependence. For example 52.1{ti] -+ 5'2.2[t2] in 
equation 1 represents the references. 

2. The conditions on the index variables. These conditions map a vector to a 
boolean value. If the conditions evaluate to true for a given vector, then the 
first reference given in (1) is the source. For example, 2 < *2 < 5 A ii = 12 - 1 
in equation 1 gives the conditions. It means that for all the iterations i 2 > for 
*2,2 < *2 < 5 of the sink 52.2 the source is 52.1. Furthermore, the iteration at 
source is equal to the iteration *2 at the sink. 

In Dependence relations the loop indices for the source are expressed as functions 
of the loop indices at the sink. The affine restrictions given above allow the indices 
to be multiplied by integers. When these are converted to functional form, the 
corresponding linear con-straint becomes non-affine. For example, if the condition 
on the index variable * is c ♦ t = Ar, c being a constant, in functional form the 
constraint becomes i = [A'/cJ. This is not in affine form. For such cases, Pugh [10] 
proposed to u.se an additional wild-card variable and convert it to affine form. The 
above constraint can be written asasc**-fa=A: A 0<a<c. However, for 
clarity, such constraints are shown in non-affine form in this work. 
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Chapter 3 

Basis Of Incremental Analysis 


In this chapter, we show how dependences change on increase/decrease of the val- 
ues generated/read. Using these techniques, we show how the dependences can be 
updated for insertion/deletion of the assignment statements and for loops. 

The changes in a program may result in increase/decrease in values generated 
or increa.se/decrea.se in values read or a combination of both. The value based 
dependtmees get affected due to increase or decrease in the values generated or 
read. In thi.s work we have considered incremental updating of the flow and output 
dependences. This can be extended in a straight forward manner for anti dependence 
also. I.,einnias 3.1, 3.2 and 3.3 given below, captures the concept of value based 
dep<*ndenct'a an<! provide basis for the proofs given in this chapter. 

Lemma 3.1 If there is a dependence S'i.l[ii,s] — » 5j.x[i2,>s], and S'j.a:[t 2 ,s] access 
the location Af, then S,'.l[ii,s] is the last write to M before 5j.i[i25 5] is executed! 

Lemma 3.2 The Entry E, defines value for all the memory locations used in a 
program.. These arc the first values defined for the memory locations. 

Lemma 3.3 The imlues generated by E remain unaltered by any modification to the 
program. 
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3.0. 1 Increase In Values Generated 

The increase in the values generated introduces dependences involving the new val- 
ues. This may also invalidate some of the old dependences. Theorem 3.6 and 3.7 
given below describe how the dependences change on increase of values generated. 
Lemma 3.4 and 3.5 which follows, provide the basis of the proofs for the theorems. 

Lemma S.4 l/ti there be a dependence 5,'.l{ti,5] —* 5j.l[t2,s]. Suppose c depen- 
dence s] appears due to an increase in the generated values then 

< 5j.l(»2,s]. 

Proof : Ix*t Si.llii,.*!] write to the memory location M then 5 j.l[i 2 , 5 ] and 5 i.l[t 3 , 5 ] 
also write to M. The dependence from S;.l(ii,s] to implies, 5,-.l[*i,5] 

5 j.l(i 2 j 5 ] the dependence from 5i.l[ii,s] to 5 t.l[t 3 , 5 ] implies, 5,[ii,s] -C 5 fc[i 3 ,s] 
(by definition of dependences). If 5 j(i 2 ,s] -C 5 jb[* 3 , s] then the source for 
is Sj.l[t 2 »>s), because both of them write to the same memory location M, and 
^ But the dependence from to 5 fc.l[* 3 ,s] contradicts 

this. Hence S'i.l[* 3 ,s] <. 5 j.l[t 2 ,s]. The dependence 5,-.l[ti,s] -+ 5 fc.l[z 3 ,s] implies 

5.. 1[i|,s] < .9*,.l(i3,.s]. Hence, 5,'.l{ri,s] < 5it.l[*3,-s] C S'j.l[i2,5].l 

Lemma 3.5 Lei there be a dependence S,-.l[ti,s] 5j. 1 ( 1255 ]. Suppose a new de- 
pendence ”4 5^.1 [i 3 ,s], is formed as a result of increase in the generated 

values then 5 i.![j 3 ,.s] is the last write before Sj.l(t 2 ) 5 ]. 

Proof : Let 5,.l[ii,s] write to the memory location M then and 5 y.l[i 2 ,s] 

also write to M. Assume that there is a write say 5 p.l[tn, 5 ] between 5 jfe.l[i 3 , 5 ] and 
By Lemma 3.4, 5 ,'.l(ti, 5 ] C -C 5 j.l[i 2 ) 5 ]. This implies that 

5i.l[ii,s] < 5p.l[j„,s] < Sj.l[t 2 , 3 ]. The dependence from to 5 j.l[r 2 , 5 ] 

implies that there is no write between 5f.l[ii,s] and 5 j.l[i 2 - 5 ] (by Lemma 3.1). This 
contradicts the assumption above. Hence, 5^.1 [* 35 5 ] is the last write before 5 j.l[t 2 ) 5 ] 
to the memory location M.I 

Theorem 3.6 Let there be a dependence 5,-.l[ii,5] *S'j-l[* 2 j 5 ]. If a new depen- 

dence Si.l[zi,s] Sfc.l(i 3 , 5 ] ts formed due to increase in the generated values, then 

Sjb.l{t3,5] 5j.l[f2,5]. 
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Proof : Let 5i.l{*i,s] write to the memory location M. By Lemma 3.4, 5i.l[t3,5] 
is a write in between 5..1(*j,5] and By Lemma 3.5, 5fc.l[*3,s] is the last 

write before 5,.l(«2,s] to the memory location M. By the definition of dependences 
it follows that there is a dependence from S’fc.l(»3,s] to 

Theorem 3.7 Let there be dependences of form S'i.l(ti,s] —* Sj.x[i 2 ,s], for x ^ 1. 
If a new dependence S’,.l{ii,s] — » Sjfe.l(* 3 ,s} is formed due to increase in the generated 
%'alues, then 5*.l{i3,.i] — ♦ 5j.x{i2,s] provided i^ <C * 2 - 

Proof : 5,.l{ij,5] write to the memory location M, then 5*.l(t3,s] also writes 

to M. 5 j.x[» 2 ,s] wriU*s to M if x = 1 or reads from M if x 7^ 1. The dependences 
5',.l{ii,s] —» 5;.x[i2,5] and Si.I[ii,s] — ♦ 5t.l[*3,s] implies S’j.l[ji,s] ■< 5j.x[i2,s] and 
5,.l[fi,s) < 5*.1 (j 3,5]. 

Now, either <. 5j.xfi2,s] or 5j.x[t2,s] < 5i.l[i3,s]. By Lemma 3.4, 

there is no write to M between 5^.1 [*'3,5] and 5,-.x[z2,s].If S'j.x[z2,s] <C 
then 5j.x{i2,s] 5*.lfi3,s]. If 5i.l[t3,s] < S'j.x[i2,s] then 5fc.l[*3,<s] —*■ 5j.x[*2,«]- 

I 

Example : Consider the program in the figure 4(a). The values generated by the 
statement.s are, 

S.l'l 

S,[.) 

The dependences in the program are, 

<5i(li] — ► 52.1 {*2] I 1 ^ ^2 ri A 2i = *2 

52(*i] 53.1 [r2] 1 1 < *2 ^ ^ ^ *1 == *2 

5i(fi] -♦ 53.1 ft2] I n + 1 < *2 < 3n A t’l = t2 

Now if the upper limit of the loop I is increased from n to 2n as in figure 4(b), 
there is an increase in the values generated by the statement 52. The new values 
generated are 52(t] ] n + 1 < * < 2n. For these values, the source function is, 

5i[ti] 52.1 [t2] I n + 1 < 12 < 2n A i2 = h 


I 1 < » < 3 n 

I !<*■<« 

I 1 < f < 3 n 
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For * = l,3n For i = l,3n 


5. : 

/i(0 = ... 
Endtor 

II 

W 

1 : 1 

For * = l,n 

For i = l,2n 

S 2 : 

A{i) = ... 

A{i) — ... 


Endfor 

Endfor 


For i = l,3n 

For i = l,3n 

53 : 

yi(i) = ... 

A{i) = ... 


Endfor 

Endfor 


(a) 

(b) 

Figure 4: 

Changes in values generated 


the increase of the loop limit, the source for for the values 53-1 [*] | n+ 

1 < I < 2n was Si. After the change, the statement S 2 overwrites the values written 
by 5*1.1 in the memory locations referred to by 53-1 above. Hence, by Theorem 3.6 
for the values above the source for Sa-l is Sj.L The new dependence in the program 
are, 

5'l(*l] 5 j.1|J2] I 1 ^ *2 ^ 2?! A *1 = *2 

Sal*,) 53-1 {* 2 ) I 1 < *2 < 2n A ii = is 
5'i[ii] — + 63.1 [* 2 ] 1 2« + 1 < *2 < 3n A ii = is 

3.0. 2 Increase in Values Read 

Increase in values read will only generate new dependences involving these values. 
It do***! not affect any previous dependences. The incremental analysis for increase 
in values read is to compute the dependences above. 

3.0. 3 Decrease lu Values Generated 

Decrease in the values generated not only invalidates the dependences involving 
these values, but also generates new dependences as given in the Theorem 3.8 below. 
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Theorem 3.8 Ut tfurt be diptndinccs as 5i.l(t3,s] -+ S,-.l[ii, 3 ] and 5,-.l[2i,5] -♦ 
5 ;.x[j 2,«]. Suppose as a result of deaxasc in the values, if 5,.l[ii,s] is not generated 
then, 5*.l(t3,«] 

Proof : Lei 5,.l(*i,3] write to the memory location M, then 5jt.l[*3,5] also writes 
to M. 5j.x{«2, 3] writes to M if x = 1 or reads from M if x ^ 1. The dependence 
-+ 5j.x[i2,3] implies, 5i.l[ji,s] < 5j.x[»2,3|. The dependence 5;fc.l[t3, 3] -4 
5,.l(ii,s] implies, 5*. 1(13, s] < 5i.I(ji,3]. Hence, S'fc.lffsja] < S'j.x[t2,s] Before the 
decrease in the values, .‘'jt. 1(13,3] is the last write to M before 5i.l[ti,s] and 5i.l[xi,3] 
is the last write to M before 5j.x(i2,3|. If 5,.l(ii,s] is not generated, then the last 
write to M before is />fc. 1(13,3]. Therefore, by the definition of value based 

dependence, 5i.l(i3»5 ] — ♦ <J'j-X'(j2,3]. I 

Example : Consider the program in figure 4(b). The values generated in the 
program are, 

Si.l(f] I 1 < X < 3n 

52.1 (x] I 1 < i < 2n 

53.1(1] 1 1 < X < 3n 

The depeinlenres in the program are, 

“+ ^S*1(x 2] I 1 < t 2 < 2n A x’l = X 2 

53(11] 53.l(f2] 1 1 < X2 < 2n A x'l = X2 

5i[ti] ”♦ 53.] (X2] j 2n + 1 < X2 < 3n A Xj = 12 

If the upper limit of the index x is decreased from 2n to n, the resulting program is 
shown in figure 4(a). Now the statement S 2 does not generate the values, 52.1 (x] | n+ 
1 < * < 2n. Statement 5i is the immediately preceding write to the locations written 
by the values above, and Sz is the immediately succeeding write to the locations 
after S^. Hence, by Theorem 3.8, on decrease of values, the new dependences are, 

5i[xi] — > 52*1 [x'z] 1 1 ^ X 2 ^ XX A ii = i 2 

52{*i] 53.1[x2] 1 1 < X 2 ^ XI A Xi = X 2 

5i[xi] -4 53.1 [x2] 1 XX + 1 < 12 3n A Xi = X2 
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Algorithiii iiicrAiialyjiisInsStmt 

Input : Statoinnit *S' : The new statement inserted 

Output : l>ep<Mu!f‘nce Relations newDeps : The set of new dependences 

1 newDep = 

2 For all references S,k in 5 do 

3 newDep = newIVp U Find Dep( 5.1:, (S.ib,s], S,U) 

4 Endfor 

5 For each dependence DcpRtls.s i in DepRcls.i such that Si S do 

6 invalidDoinain = Domain(/>ep/?f/ 5 , 5 1 ) 

7 For all old dependences as DcpRils.Sj r such that Sj ^ S 

8 un(\ivered = Range(/>pHf/ 5 ^ 5 ^ invalid Domain) 

9 r - r \ "»inval id Domain 

10 if ( X == 1 ) 

11 scMirce = S 

12 else 

13 sourcf’ t-: 5 U 5, 

H newDep :: ne\s Dep U Fin<iDep( Sj.x, unCovered, source) 

If) Eiulfor 

IG Kndfor 


Figure 5: Incremental analysis - Insertion of assignment statement 

3.0.4 Decrease in values read 

'Flu' (i<rr<'«ts<‘ of goiK’ratod valiH'.s invalidates certain dependences. This is expressed 
in th<‘ Lejiuna th<’ proof for which is obvious and omitted. 

Leinina 3.9 Ltt ihtn bi (i dipt 7td( vet fimn Si.l[ii,s] to Sj.x[i 2 ,s]. If on decrease of 
ytunvtid voUk s, .S',. 1 s] or Sj.T[i 2 ,s] is not gcncrakd, then the dependence 

is not valid. I 


3.1 Insertion of Assignment Statement 

The insertion of an assignment statement, say S increases the values generated 
in the program because of the write S.l and the values read because of the references 
S.k for A- > 1. The algorithm for incremental analysis, incrAnalysisInsStmt is 
given in figure 5. 

In the algorithm, the source function for all the references in S is calculated in 
statements 2-4. The references outside S, which have their dependence affected, 
and their new dej^endences arc comjmted in statements 5-16. In each iteration of 
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the loop in statement 5, the dependences affected because of a new dependence 
as DepRels^s.i, and the resulting new dependences are computed. The variable 
invalidDomain contains the values of reference 5i.l in the dependence DepRds,s.\- 
The source for a value Sj.x[r, s] may be changed if its source say, S',-.! [lu, s] is in the set 
invalidDomain. All such s] and their new source are calculated in statements 

7-15. In each iteration of the loop in statement 7, the dependences for a reference 
Sj.x having values in invalidDomain as source are updated for the new dependence. 
The variable uncovered computed in statement 8 contains the values of Sj.x for 
which source is in invalidDomain. In statement 9, the dependence D€pRels,s,.x is 
restricted to contain only those values of Si.l that are not in invalidDomain. This 
removes the part of dependence that may no longer be valid. Then the source for 
values in notCovered is calculated in statements 10-14. If x = 1 in Sj.x, then the 
source for the values of 5j.l is only S, as given by the Theorem 3.6. If x > 1, then 
the source may be S or Si as given by the Theorem 3.7. The source function for 
the value in notCovered is calculated in statement 14 by function FindDep. The 
function finds the source for the values of Sj.x in set uncovered. The possible source 
references for these values is in the set source. 

Example : Consider the program in figure 6(a), the dependences in the program 
are, 

E^5i.l[t2,;2] 1 l<»'2,i2<20 

‘S'3.l[f2,i2] 1 1 < *2,72 < 20 A ii = l2 A jfi = 72 

'5'3-2[*2i72] I 1 < *2 ^ 20 A 1 ^ 72 — ^ h — *2 A ji = 2^2 

E ^ 53.2[f2,72] I 1 < 12 < 20 A 11 < i2 < 20 

‘53[*1,7i] ‘54-1 [ 22,72] 1 1 < *2,72 < 20 A h = 22 A ji = 72 (2) 

If the statement S2 is added at the position indicated, the resulting program is 
as shown in figure 6(b). The process of updating the dependences by the algorithm 
is given below. 

First the source functions for 52-1 and ^2.2 are calculated. The dependences for 
the references are, 

Si[iiJi] 52.1[22,72] I 1 < i2 < 20 A 1 < i2 < 10 A 2i = *2 A ji = 272 
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For I : 

= 1, 20 

For 

i = 1,20 

For f = 1, 20 


For j = 1,20 

For j = 1, 20 

For j = 1, 20 

s, 


a(i,j) = 2 


a(i,;) = 2 

a{i,j) = 2 


Endfor 

Endfor 

Endfor 


Endfor 

Endfor 

Endfor 

h 

For i : 

= 1, 20 

For 

t = 1, 20 

For i = 1, 20 

h 

For j = 1 , 20 

For j = 1, 20 

For j = 1, 20 

S 2 


a(i,2j) = a{ij) 

1 a(«,2i) = a(i,i) 

S 3 


a(iJ) = a(t,2j) 




Endfor 

Endfor 

Endfor 


Endfor 

Endfor 

Endfor 


For i : 

= 1, 20 

For 

i = 1, 20 

For i = 1, 20 


For j = 1, 20 

For j = 1, 20 

For j = 1 , 20 

s. 


a(ij) = 2 


a{i,j) = 2 

a(t,i) = 2 


Endfor 

Endfor 

Endfor 


Endfor 

Endfor 

Endfor 



(a) 


(b) 

(C) 


Figure 6: Example for addition/deletion of Assignment Statement 

E ^ 52.l[i2,i2] I 1 < ^2 < 20 A 11 < j2 < 20 

S 2 [hJi] S2.2[i2,j2] I 1 < * 2 ,i 2 < 20 A even{j 2 ) A ii = 22 A 2ji = j’a 

*Sl[ 2 l,il] 52.2[22,;2] 1 1 < * 2 ,i 2 < 20 A odd{j 2 ) A ii = 22 A ji = j 2 


( 3 ) 

Consider the new dependence DepRelsiS 2 .i- The invalidDomain corresponding 
to this dependence is 5i[2, j] 1 1 < i,j < 20 A €ven(j). The old dependence that may 
be possibly affected because of the new dependence is DepRelsiSs.i- The variable 
uncovered calculated in statement 6 is 53.1[2,j] 1 1 < i,j < 20 A even{j). The 
part the dependence that is not affected (calculated in statement 7) is, 

V 

5'i[2i,Ji] 53 . 1 ( 22 , ^ 2 ] 1 1 < « 2 ,i 2 < 20 A odd{j 2 ) A ji = 32 A 2 i = 22 

Reference 53 . 1 is a write hence, the possible source is only S. The new depen- 
dence for the values of 53 . 1 given above is, 

Siiiuh]^ S 3 . 1 [i 2 j 2 ] I l<*2,i2<20 A even{j 2 ) A 21 = 22 A 2ji = j 2 
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Algorithm incrAnalysisDclStmt 
Input : Statement S : The statement deleted 

Output : newDeps : The new dependences generated on deletion of S 

1 newDep =: (f> 

2 For each old dependence relation DepRels^s.i do 

3 invalidDomain = KB,nge{DepRels,s,x) 

4 For all dependences as DepRelss.i 

5 invalidDomain = invalidDomain U (Range(jDcp/Ze/ 55 .i) H -*Domain{D€pRelss.i)) 

6 Endfor 

7 For all old dependences as DepRelsSj.x 

8 notCovered = Range(DepiZc/ 55 ^.a.\ invalidDomain) 

9 newDep = newDep U FindDep(5j.x, notCovered, Si) 

10 Endfor 

1 1 Endfor 

12 For all dependence relation dep as DepRels.s.x or DepReIss, y 

1 3 remove dep 

14 Endfor 


Figure 7: Incremental Analysis - Deletion of an assignment statement 


Similarly for the reference 53.2, the new dependences are 


‘S'2b'l, jl] 53.2[i2,i2] I 1 < *2,72 < 20 A ii = 22 A ji = 72 


3.2 Deletion of Assignment Statement 

Deletion of an assignment statement, say 5, decreases the values generated for all 
values generated by 5.1, and the values read for all the values read by the references 
5.x, for X > 1. The incremental analysis on deletion of an assignment statement is 
done by the algorithm incrAnalysisDelStmt, given in figure 7. 

Let the statement deleted be 5. The algorithm computes new sinks for all the 
values having 5.1 as the sink. In each iteration of the loop in statement 1, the new 
sinks for one source of 5.1, say 5i.l, are computed. The variable invalidDomain 
contains values of 5.1 having 5,-.l as the source. If there is a dependence from a value 
in invalidDomain to some value of Sj.x, then the source for the value of Sj.x after 
deletion of 5 is 5,-.l (by Theorem 3.8). The variable invalidDomain is calculated 
in statements 3-6. 

Let the source for a value of 5.1, say 5.1[A:i,s], be 5i.l[fc,s] and sink be 5.1[/!:2,5], 
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a values of 5.1 itself. The new sink for 5, •.![/:, a] is 5.1(^25 5]. But 5.1[fc25 5] is also 
not generated after the deletion of 5. So, the sink of 5.1[A:2,s] is the sink for the 
value of Si.l. Again, the sink for 5.1[A:2,s] may be some value generated by 5.1. 
This continues till the last write to the location referred by 5.1[A:i,s] in the depen- 
dence DepRelss.i- The laist writes to the locations in dependence as DepRelss.i 
are values that do not have any sinks in the dependence. These are the values in 
Range{Z)epi?efss.i) H -'Domain(i)ep/lefss.i). The last writes in the dependence is 
computed in the statements 4-6. 

All the references Sj.x, that have 5.1 as source are found in statement 7. The 
variable notCovered computed in statement 8 contains the values of Sj.x for which 
the source is in invalidDomain. The sources for the values in notCovered is com- 
puted in statement 9. In statements 12-14 the invalid dependences as given by 
Lemma 3.9 are removed. 

Example : Consider the program given in figure 6(b) again. The dependences in 
the program are, 


E -+ 5i.l [ 22 , 72 ] 

1 

1 < 22,72 < 20 

•S'llfi,;!] 52.1 [ 22 , 72 ] 

1 

1 < 22 < 20 A 

E 52.1 [ 22 , 72 ] 

1 

1 < 22 < 20 A 

52 ( 21 , 7i] — » 52 . 2 ( 22 , 72 ] 

1 

1 < 2-2, 71 < 20 

‘5'l [ 21 , 71 ] ■S'2-2[22,72] 

1 

1 < 2-2,72 < 20 

‘52(21, 7l] ‘53.1(22,72] 

1 

1 < 2-2,72 < 20 

‘5i(2i,7i] ‘53-1[22,72] 

1 

1 < 22,72 < 20 

52 ( 21 , 71 ] —* 53 . 2 ( 22 , 72 ] 

1 

1 < 22,72 < 20 

53 ( 21 , 7i] -> 54 . 1 ( 22 , 72 ] 

1 

1 'S 22,72 ^ 20 


I < i2 < 10 A *1 = i2 A ji = 2^2 

II <j2 < 20 

A even{j 2 ) A = ^2 A 2ji = 

A odd{j2) A zi = 12 A ji = jf2 
A even{j2) A ij = ^2 A 2ji = j2 
A odd{j2) A = 12 A ii = j2 
A ii = i2 A ji = j2 
A ii = ^2 A ji = i2 


(4) 

If statement S 3 gets deleted, the resulting program is as shown in the figure 6(c). The 
process of updating the dependences from the algorithm incrAnalysisDelStmt is 
given below. 

The dependences found in the statement 1 are, DepRels^Sz.i ‘‘■nd DepRels^Sz.i- 
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old[5t.l , s] new[5i , s] 



decrGen(5i.l) oldGen{Si.l,s) 

old[Si.l,s]n newfSi.l,s] 
old[5i.l,s]-new[5<.l,s] ^ ^ 

Figure 8: Values generated before and after insertion of loop 


Consider the dependence DepRelsjSs.i- The values in the variable invalidDomain 
are Si :l[ii j] 1 1 < i;j < 20 A odd (j). The reference outside S3 having S3: 1 as source, 
found in statement 7 is 84:!. The values of 84:! for which new dependence is to be 
found is Range(DepRels354.i\ invalidDomain) = S4:l[i; j] 1 1 < i;j < 20 A odd(j). 
The possible source for these values, according to the Theorem 3.8 is Si . The new 
dependence DepRel5iS4.i is calculated in the statement number 9. Similarly, the 
new dependence formed for the case of DepRelsjSs.i in statement 1 is DepRels2S4.i- 
The resulting dependences in the program are, 


E — )■ Si:l[i 2 ; 12] 
Si [ii; ji] S2:l[i2; 12 ] 
E S 2 :l[i 2 ; 12] 
S2[ii; jl] S2:2[i2; 12 ] 
Si[ii;ji] -> S2:2[i2;j2] 
S2[ii; jl] S4:l[i2;j2] 
Sl[ii;jl] — ^ S4:l[i2;j2] 


1 < i2;j2 < 20 

1 < i2 < 20 A 1 < j2 < 10 A ii = i2 A Jl = 2j2 
1 < i2 < 20 A 11 < j2 < 20 

1 < i 2 ;jl < 20 A even(j 2 ) A ii = i 2 A 2ji = j 2 

1 < i 2 ;j 2 < 20 A odd(j 2 ) A ii = i 2 A Ji = j 2 

1 ^ i 2 ;j 2 < 20 A even ( 12 ) A ii = b A 2ji = j 2 

1 < i 2 ;j 2 < 20 A odd(ji) A ii = i 2 A ji = j 2 


3.3 Insertion of a Loop 

The insertion n of a loop 1, with index j redefines all the references to variable j 
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52 


h 

h 

k 

S3 

s. 


s. 


i=j=k=l 
For z = 1,20 
For j = 1,20 
For fc = 1,20 
<i{i,j,k) = 3 
a{ij,2k) = 3 
Endfor 
Endfor 
Endfor 
For t= 1,20 


For k = 1,20 
a{i,j,k) = 2 
a{ij,2k) = 2 
Endfor 


Endfor 
For i= 1,20 
For j = 1,20 
For A' = 1 , 20 
a{i,j,k) = 2 
Endfor 
Endfor 
Endfor 
(a) 


i = j = k = 1 
For i = 1,20 
For j = 1,20 
For A: = 1,20 

3 

ali,j,2k) = 3 
Endfor 
Endfor 
Endfor 
For z = 1 , 20 
For j = 2, 20 
For k = 1 , 20 
a{i,j,k) = 2 
a{i,j,2k) = 2 
Endfor 


Endfor 
For z = 1,20 
For j = 1,20 
For k = 1,20 
a{i,j,k) = 2 
Endfor 
Endfor 
Endfor 

(b) 


Endfor 


Figure 9: Example for addition of a loop 


in the scope of j as the references to index j. It results in generation of certain new 
values for j. At the same time a few old values of j may not be regenerated. Let 
the new and the old values generated by the write in a statement Si inside / be as 
shown in figure 8. Then the set of old values no longer generated after the insertion 
of the loop is obtained by complementing old by new. The set of old values which 
get re-generated is old H new. The set of newly generated values is new — old. 
Example : Consider the program fragment in figure 9(a), the possible value of 
variable j before insertion of I 2 is only 1. After insertion of I 2 , for the modified 
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program fragment in figure 9(b), the possible values of j are 2 < j < 20. The new 
values generated by references and 54 . 1 are, a{i,j,k) | 1 < t, ifc < 20 A 2 < 
j < 20 and a{i,j,2k) | 1 < < 20 A 2 < j < 20 respectively. As for the 

decrease in the values generated, it may be noticed that, index j does not take value 

1. Therefore result, the decrease in values generated by references 53 . 1 and 54.1 are, 
k) \ I < i,k < 20 A j = 1 and a{i,j,2k) 1 1 < i,^: < 20 A j = 1 respectively. 

The procedure for updating the dependences after insertion of a loop say 1 is, 

• Calculate sources for the references inside the loop 1. 

• For references outside the loop / : 

update the dependences for decrease in the values generated, 
update the dependences for increase in the values generated. 

Algorithm incrAnalysisInsLoop for incremental updating of dependences due 
to insertion of a loop is given in figure 10. The source functions for all the references 
inside the loop is computed in statement 8. The variable decrValues, is an array of 
sets. Each set, say decrGen(5i.l) contains values of 5,'.l, that are not generated by 
5,-.l after the loop is inserted. The variable oldValues, is also an array of sets. Each 
set say, oldGen(5j.l) contains the values of 5i.l, that are generated both before and 
after the insertion of loop. Pictorially, these variables are shown in the figure 8 for 
a reference 5^.1. A dependence dependence DepRelsiSj.a is affected due to decrease 
in generated values if, 

1. Sj is outside the scope of I and 

2 . Si is inside the scope of I and 

3. Domain(jDepi?el 5 ,Sj.a) C decrValues(5i.l) 

The resulting new dependences are computed in the statement 10. 

The kind of dependences that get affected as a result of increase in generated val- 
ues after insertion of a loop are characterized in Lemma 3.11 and 3.10. The resulting 
new dependences are computed in the statement 13 using these dharacterization. 
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Lemma 3.10 Let S’,-.! (ii , s] write to a memory location M and a dependence S',-.! [ii , s] — »■ 
Sj.x(t2,5] exist. Now suppose a loop I is inserted such that Sj is outside the scope 
of I, and Si.l[ii,5] is generated after the insertion also, then all the writes to M in 
between S,-.l[ji,s| and «] are new values generated. 

Proof : Let the dependence chain for the memory location M after the insertion of 
/ be of form, 

S,'.l [t j , s] ► S^.l [t 3 , 5] , . • . Sg.l [25, sj, . . . , S,].! [^49 *x[t2 j 

Let the value S,.l[t 5 ,s] also be generated before the insertion of 1. Then it must 
bo a write in between S,-.l[ii,s] and Sj.i[i 2 ,s]. But the existence of dependence 
S,.1 [ti,s] — ♦ Sj.T[? 2 , 5 ] before the insertion of I implies that there is no write in 
between S,-.l[?i,s] and Sj.x[t 2 ,s]. This contradicts the above assumption. Hence, 
all the writes to M in between Si.l[ii,s] and Sj.a;[t2j5] are new values.1 

Lemma 3.11 Let there he a dependence as S,-.l[ii,s] — » Sj.i[ii,s]. Suppose a loop I 
be inserted such that Sj is outside the scope of 1. The source for Sj.x[i2,5] is changed 
due to increase in the generated values only if a dependence as S,-.l[ii, s] — > S*.l[i 3 , s] 
is formed and Sk is a new value formed after the insertion ofl. 

Proof : Follows directly from Lemma 3.10. I 

The function updateDeerGen updates the dependences for decrease in generated 
values after insertion of a loop. It finds the new sources for the values of S,.a, in 
the dependence DepRelSfSq.a- The variable invalidDomain in statements 14, gives 
the values of Sp.l that were source for the values of 5, .a before the insertion of 
the loop, but are not generated anymore. The dependence DepRelspS„.a remains 
valid for the values of 5p.l in the set oldValues(5'p.l) after the decrease of values. 
These are the values of Sp.l that get generated both before and after the decrease 
in the values. The variables are denoted pictorially in figure 3.3. The inner circle 
represents the values in Domain{DepRelsiS,.a)‘ Lemma 3.12 gives the process to 
update the dependences for decrease in the generated values after the insertion of 
loop. The proof for correctness of Lemma 3.12 is obvious, however, we will give 
proof for termination of the process. Lemma 3.3 and 3.2 provide the basis of proof 
for Lemma 3.12. 


25 



Algorithm mcrAnalysisInsLoop 
Input : Loop : I /*The loop inserted*/ 

Output : Set of Dependence relations : newDep /*The set of new dependence relations*/ 
Modifies : The dependences relations of references affected. 

1 For all assignment statements S,- do 

2 Array of sets : d€crValiies(5i.l) = <l> 

3 Array of sets : oldValues(5i.l) = old[Si.l,8] 

4 Endfor 

5 For all writes 5,'.x inside / do 

6 If(a'==l) 

7 decrValiies(Si.x) = old - new[5i.ar,s] 

8 oldValTi€s(S,‘.x) = new[Si.x,s] H old[5i.x, s] 

9 Endif 

10 newDep = newDep U FindDep(5.x, [5.x, s], 5, U) 

1 1 Endfor 

12 Void DepRds^Sj.c such that 5,- is inside / and 5j outside I 

updat€DecrGen(Depiic/si5,.a) 

13 ^DepRels.Sj.a such that Sj is outside I and 
3 lit'wDepRels.Sk i such that Sk inside / 

updat€lncrGen(jDcpiie/s,Sfc.a\ oldValues(5i)) 


up dateI>ecrGen( DepRels^ s, . a ) 

14 Set of values : invalidDomain = T)omBin{DepRelsj,Sg.a) H decrValues(Sp.l) 

15 For all old dependence as DepRelskSp.i 

16 DtpRels^s,.a = iecTGeii{DepRels,s,.a,DepRels^s,.i, invalidDomain) 

17 If ( DepRelSkSg.a <t> ) 

18 updateDecrGen(Depi?e/s*s,.o) 

19 Endif 

20 Endfor 

21 DepRels,Sg.a = DepRels,s,.a\ oldValues(5p.l) 


updateIncrGen(Z?epiZe/5^5^.a) 

22 For all new dependences DepRels^s^ i such that St.l inside I 

23 DepRelstS,.a = incrGen(Depi2e/5^5,,a,i3ep/2eIs,St.i)) 

24 If ( DepRels^s,.a # <f > ) 

25 updateIncrGen(Depiie/sn5,.a) 

26 Endif 

27 DepRels,s,.a = DepRels,s,.a/ “* Range(DepiJe/s»5,.o) 

28 Endfor 

29 nesDep = newDep U DepRels^s^.a 


Figure 10: Incremental Analysis - Insertion of Do loop 
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Figure 10: Domain of an old dependence 


Lemma 3.12 Let there be a dependence as — » iSj.l[t 2 ,.s]. After deletion 

of a loop I such that Sj is outside I, is not generated, the new source for 

can be computed by a finite number of recursive updates for decrease in 
the generated values. 

Proof : Let write to memory location M. The reference 5j.a[i2,s] writes 

to M if a = 1, or reads from M if a ^ 1. 

From Lemma 3.2, Entry E is the first write to M. The dependence chain corre- 
sponding to memory location M is of the form, 

E )Sp.l[f4, s], 5p.l[i45 ^ ‘55.1[^55^] ^r[^6)^] ^ s] ^ iS'j.<l[i25 ^]- 

If 5',-.l[ii,s] is not generated after insertion of loop 1. Theorem 3.8 should be ap- 
plied for decrease in the generated values. This implies, the last two dependences 
in the dependence chain must be merged. More precisely, the dependence chain 
corresponding to memory location M are after the first updating is, 

E 5p.l[z4,s],5p.l[i4,5] ->■ 5'j.a[i2,5]. 

According to the theorem, the process of updating stops on detecting a value that 
is generated after the decrease in the generated values. When the source say 5,-.l 
is outside /, then there is no change in the values generated by Si.l. Hence, the 
updating process stops after single application of Theorem 3.8. If the source is 
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inside I and is re-generated after the insertion the process terminates. However, 
when there are no such source references in betw^n, the repeated application of 
Theorem 3.8 on the dependence chain for M will eventually lead to, 

at one stage. From Lemma 3.3, there is no change in the values generated by JE. 
Hence, for a finite length program the process will eventually terminate.! 

The function decrGen updates the dependences according to Theorem 3.8, and 
the recursive call to updateDeerGen in statement 18 updates the new dependences 
generated by dccrGcn for decrease in the generated values. The part of the de- 
pendence, that is not valid after the decrease in values generated is removed from 
DcpRels^s^^a in statement 21. 

The incremental updates for increase in the values generated is done by the 
function updateIncrGen. This is also a recursive function as updateDeerGen. It 
finds the new sources for the values of Sg.a in the dependence DepRels^s^.a- 

The dependences in newDeps are new dependences generated after the insertion of 
/. A new dependence DepRelspSk-u implies that some values of 5p.l are overwritten 
by the reference Sk-l- Hence, the dependence DepRelsj,Sg.a must be updated for 
increase in the values generated by 5^.1. A dependence DepRelsj,Sg.a is updated for 
each of the new dependence as DepRels^Sk-x i^i newDeps in statements 22-28. The 
updating is done by the function incrGen in statement 23 as given by Theorem 3.6 
and 3.7. The function forms a new dependence DepRelskSg.a' This dependence 
contains the values of Sg.a for which the new source is Sk- The values of 5j.a, for 
which the source is changed axe removed from DepRelsj,Sg.a in statement 27. 

The values of iSjfc.l may further be overwritten before referred to by Sg.a as given 
in the proof for the Lemma 3.11. Hence, the new dependence must also updated 
with function updateIncrGen as in statement 25. The dependence DepRelspSg.a 
remaining in the statement 29 is valid after the insertion of the loop /, and is added 
to nevDeps. 

Example : Consider the program given in figure 9(a). The dependences in the 
program are, 

-4 5i.l[i2,i2,^:2] I 1 < *2, j2, ^2 < 20 A et;cn(fc2) A 21 = ^2 A 
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ii = 32 A 2ki = 

E ^ 5,.l{t2,i2, ^2] I 1 < t2,i2, *2 < 20 A odd{k2) 

E -+ 52.l(t2,i2, M 1 1 < *2,725^2 < 20 

—* ^3-1[*25^'2] I 1 < *2,^2 < 20 A even{k2) A 
“ ^2 A 2k ^ A^2 

-+ 53.1 [*2,^2] I 1 < t 2 ,Ar 2 < 20 A odd{k2) A ji = 1 A 
*1 = *2 A ji = ji A ki = k2 

-+ * 94 . 1 ( 12 , i-2] 1 1 < 12 < 20 A ji = 1 A 1 < *2 < 10 A 

M = *2 A ji = ji A fri = 2^2 

■92[ji,ii,A-i] -♦ 94.1[»‘2,A'2) 1 1 < t2 < 20 A ii = 1 A 11 < A-2 < 20 A 

»1 = *2 A ji = ji A ki-k2 

‘S'ahuA'i] -+ S's.l[i2,i2-A:2] 1 1 ^ ^ 2,^2 ^20 A ^'2 = 1 A ii = (2 A ki = k2 

A'l] — » S5.1{t2,i2, Ar2] 1 1<*2, A:2< 20 a 2 < ^2 < 20 a * 1=12 

A ji = 32 A ki = k2 

Tlic process of updating dependences by the algorithm incrAnalysisInsLoop on 
insertion of the loop I2 is given below. 

The decrValues and oldValues for the statements S3 and ^4 are, 

decrValues(5'3.1) = 53[i,y, A:] | 1 < i, A: < 20 A j = 1 

decrValues(5'4.1) = 54[i,j, 2Ar] | 1 < i, Ar < 20 A y = 1 

oldValues(53.1) = 4 

oldValues(5'4.1) = 4 

The dependences for the references inside the loop inserted are, 

‘9i[*i,yi5 Ajj] — »■ S3.1[i2>y2> A:2] I 1 ^ *2> A2 ^ 20 A oddik'^ A 2 < j2 ^ 20 A 

z'l = 12 A ii = j2 A ki = k2 

^4[ti,yi,A:i] — »• 53.1[i2,y2> A:2] | 1 <*2,^:2 <20 A even{k2) A 2 < 72 < 20 A 

ii = *2 A ji = j2 A 2Ai — k2 
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I 1 < *2 < 20 A 2 < J2 < 20 A 1 < itj < 10 A 
*1 = *2 A ji = J2 A ki= 2k2 

52(»i,ii, A'l] 5<.l{i2, > 2 ,^- 2 ] I 1 < t2 < 20 A 2 < ia < 20 A 11 < ;fc2 < 20 A 

*1 = *2 A ji = ja A ki = k 2 

The dependenc«! are then updated for the decrease in the values generated. 
DcpRelSsS!,.! is the only dependence affected as a result of decrease in the val- 
ues. The function updateDeerGen is called with the dependence DepRelsiSi.i- The 
invalidDomain is the complete values of in the dependence, that is, 

invalidDomain = 53.1 [?,j, A*] ] 1 < 2 , A- < 20 A j = 1. 

The variable dep = ^ because, oldValues(53.1 ) = <f>. The old sources for 53-1 cor- 
responding to the values in unCovGen are 5i.l and 54 .I. Dependences DepRelsiSi.i 
and DepRelstSi.i are formed in statement 22. The dependences formed above are 
are, 

5i(2i, ji, A'l] -4 55.1[z2,j2,A-2] I 1 < 22 ,A :2 < 20 A odd{k 2 ) A ja = 1 A 

f] = A = 32 A ki = k2 

A."j} —4 55-l{t2,j2i Ala] I 1 ii-,k2 < 20 A even{k2) A j2 — ^ A 

tj = *2 A ji = j2 A 2A:i = k2 

The new dependences above are updated by the function updateDeerGen in 
statement 23. Consider the case of DepRelsiSi.i- There is no change in the values 
generated by 5i.l. Hence, there are no new dependences formed in statement 22, 
and the dependence is valid after the decrease in the generated values. Consider 
the case of DepRel$^Si,i- The values in Domain(DcpJ?e/ 5 ^Sj.i) are no longer gener- 
ated. The variable invalidDomain contains all the values of 54.1 in the dependence 
JDcpRepSiSi,.! • The source reference for these vsdues of 54.1 is 5i.l. Hence, the source 
for the values of 55-1 in the dependence above is 55.1. The dependence formed as a 
result of this is, 

5i[*i,ii,A:i]-> 55.1[*'2,i2,A;2] 1 l<i2,A^2<20 A ei;en(A:2) A j2 = 1 A 

*1 = ii A ji = j2 A fci = A:2 
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The function updateDccrGen is called with the dependence above. There is no 
change in the values generated by 5i.l, hence there are no dependences formed in 22, 
and the complete dependence DepRels^Si.i is valid. The dependence DepRels^Si.! 
after the updating for decrease in the generated values is, 

ills'll I J ^ *2»i2,^2 < 20 A ii = *2 A ji = ^2 A ki = k2 

I’he dependences affected as a result of increase in the values are updated in state- 
ment 16. 'I’he only dependence affected because of increase in the values generated 
is Si,.]. The function updatelncrGcn is called with DepRelsiS^.i- The statement 
Si is not afr<*cted by the insertion of the loop, hence the function updateIncrGen is 
calhsl with coini>lete dependence DtpRels^Si.i- Some of the values of i?i.l in the 
dependence I)ipR<ls,f!...i are overwritten by the references 53. 1 and 54. 1 as given 
by the dependences DipRcls,Si.i and DepRels^St.i in newDeps. The dependences 
DcpRclsiSi.i and DcpRtls;^s,^,i formed in the statement 34 are, 

A-i] ^ Ss.l[t7.h,k2] j 1 < ^2,^2 < 20 A odd(k 2 ) A 2 < ja < 20 A 

*1 = ^2 A ji = ia A ki=k2 

*S4[t! 1 Ji ) ^ ‘Sj.l (fa* J2i ^'2] I 1 !^f2*^2 20 A even[k2) A 2 < y’a ^ 20 A 

tj = ta A j\ = ja A 2ki = Ara 

I'lie values in th<* dependences above are removed from the dependence 
DepRelsiSs.i in statement 29. The resulting dependence Z)epi?e/siSi.i is, 

^"i] 'S'5.1[i2,i2,^2] I l<f2,^2^20 A ja = 1 A 

ij = I'a A ji = ja A ifci = fca- 

The new dependences DepRelssSi.i and DepRels^Si.i formed above are again 
updated for decrease in values by the function updateIncrGen in statement 35. 
For DepRels^StA, there is no further overwriting of the values. For the case of 
dependence DepRels.s,.!, the values of 54-1 in DepRels^s,.! are overwritten by ^3.! 
as given by the dependence DepRclstSi.i- The dependence formed in statement 27 
is, 

Sz[iiJi,ki] -> Ss.l[i2,j7,k2] I 1 < hM < 20 A even{k2) A 2 < ja < 20 A 

t'l = t'a A ji = j2 A fci = fca 
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This function updatcIncrGcn is again called with the dependence above. There is 
no more overwriting of values written by S 3 .I in the dependence. Hence there no 
more cal! to the function updatcIncrGen. The dependences for the reference iSs.l 
after updating for increase and decrease in the generated values is, 

53 {*„ j„ 5 ’s.l(» 2 ,i 2 , itj] I 1 < t 2 < 20 A 2 < is < 20 A 1 < *2 < 20 A 

*1 = *2 A ji = 72 A ki = k2 

•S-l('2»i2tM I a 72 = 1 A 

*1 = »2 A jj = 32 A k-i = k2 

3.4 Deletion of Loop 

I’he deletion of a loop I with index j, redefines all the references to the index i in 
the scope of f, as the references to the variable 3. It results in generation of certain 
new values for variable 3. At the same time a few old values of index j may not be 
generated for variable j. As a result of this there is both increase and decrease in 
the generated values. The incremental analysis procedure on deletion of a loop is 
similar to the analysi.s for insertion of a loop. 

Example ; Consider the program in figure 9(b). The values generated by references 
53.1 and $ 4.1 are, 

c(*,i,2Jb) I l<t,A'<20 A 2<;<20 
a(t,i, Jfc) I 1 < f, fc < 20 A 2 < j < 20. 

After deletion of the loop k, the possible values of the variable j is only 1 hence, 
the values given above are not generated. There is decrease in the values generated 
for all the values above. The new values generated by the references S 3 .I and 5'4.1 
are, 

a{ij,2k) I 1 <i,A;<20 A i = l 
a{ij,k) I 1 <t,A:<20 A i = l. 

These values were not generated before the deletion of the loop, hence there is an 
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increase in the values generated by the statements for these values. The process of 
updating the de|K*ndences on deletion of loop h is given below. 

'Fhe variables docrValues and oldValues for the statements inside k are, 

decrValues(53.1 ) = 53[j,i, ^r] | 1 < i, Ar < 20 A 2 < j < 20 
docrValues(S4.1) = 54{t,i,2i-] [ 1 < i,Ar < 20 A 2 < j < 20 
oldValues(5'3.1) = <f> 
oldValues{54.]) = <f> 


I’he new d<’pen<len< <’s for the references inside the loop I2 are, 




^'2] 


^l] •5^4-1 [*2i ^* 2 ] 


^2\h , il > ^*1 ] ~+ 1 {l2» ^’ 2 ] 


1 < *25 ^'2 < 20 A oddik^) A = 1 A 
ij = *2 A ki = i'2 

1 < *2j^2 < 20 A even{k2) A *i = 22 A 2fci = ^2 
1 < *2 < 20 A ii = 1 A 1 < ib2 < 10 A 
t'l = 12 A iti = 2A'2 

1 < *2 < 20 A j, = 1 A 11 < ki < 20 A 
*1 = t2 A ki = ki 


Fir.st the dependences arc updated for the decrease in the values generated. 
I'he only dependence affected is DepRelsiSi.i- Consider the call of the function 
updateDeerGen with the dependence DepRels^Si.i' Similar to the case in insertion 
of the loop, the possible writes are Si and 84- The dependences DepRels.Si.i and 
DepRels^Si.i are formed and are updated for further decrease in values. In case of 
dependence DcpRelsjSi.i^ there are no more changes and the dependence is valid. In 
the invocation of updateDeerGen with DepRcls^Si.i^ the dependence DepR&lsiSi.i 
is formed and, again the function updateDeerGen is called with this. There are 
no more changes to the dependence. The resulting dependence after updating for 
decrease in the generated values is, 

I l<i2<20A2<i<20 M<fe<20 A 
ii = t2 A ji = ji A ki — ki 
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Th<*n thf dl<*|»rnd€'nr<'s ar<* updated for incrcjusc in the values generated. Again 
the proress for updating is same a.s for insertion of loop given before. The resulting 
dei>endenre after updating for increase in the generated values are, 

1 1 £ »2i^‘2 <20 A j2 = 1 A t’l = tj A A:i = fca 
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Chapter 4 

Implementation 


This fhaj>t<*r deals with tli<* algorithms wc have implemented. The incremental 
algorithms presciit<*d in thi.s chapter are implemented over the UMCP version of the 
Tiny tool. 'Fhe algorithm “Lazy Array Data-Flow' Dependence Analysis” proposed 
by Vadim Maslov [7] is used for exhaustive analysis. The algorithm with a small 
modification to accept different inputs is given in the Appendix A. 

The concept of “Dependence crossing a statement” is defined below. This con- 
cept is use<i in th<' incremental form of the exhaustive algorithm. 


4.0.1 Dependence Crossing An Assignment Statement 

A dependence Sj-arffaiS] crosses an instance of an assignment statement 

5{t3,s] if, the instance S'{! 3 ,s] is executed in-between and 5j[i2,5]. That is 

54*1,5] < 5[l3,5] < 5j[22,s]- 

A dependence relation DepRels,Sjj: crosses an assignment statement S if, there 
exists an instance of the dependence S','.l[ji,5] —* and an instance of an 

assignment statement 5, say 5[i3,5] such that 5i.l[*i,s] 5j.a:[i2,5] crosses 5[*3,s]. 

An approximation to the definition above can be defined as given below. 

A dependence DepReIs,Sj.x crosses an assignment statement S if, 

• it is loop independent and < 5 -C Sj or 

• it is loop carried and S is inside the loop carrying the dependence. 
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This definition is conservutive. It may say that a dependence crosses a statement 
wlirn it does not . However, if the dependence crosses an assignment statement, the 
definition always says so. 

4.0.2 Dependence Crossing Loop 

Consid<T that For and Enijor statements of every loop are executed before and 
after each iteration of the loop respectively. A dependence crosses the loop I if, the 
dep<‘ndence crosses either For or the Endfor statement of the loop. An approxi- 
mation to the above definition in terms of the loop carrying the dependence can be 
defined as below. 

A dependence crosses a loop /„ if, 

• it is loop independent dependence carried by loop I, and /„ is inside i. 

• it is loop carried dependence carried by loop /, and is either / or inside 1. 
This definition is also a conservative one. 


4.1 Insertion Of An Assignment Statement 

'I’he insertion of an assignment statement increases the values generated in a 
program as given in chapter 3. The algorithm IncrAnalysisInsStmt given in 
figure 12 updates the dependences on insertion of an assignment statement. The 
analj'sis on insertion of a statement S consists of the following steps, 

1. Find the source functions for all the references in the statement S. 

2. Find the references outside S say, Sj.x such that the sources functions of Sj.x 
are affected. 

3. Find all the values of reference Sj.x for which the sources are to be computed. 

4. Compute the new sources for the values of Sj.x found in (3). 

The variables used in the algorithm are. 
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Algorithm : IncrAnalysisInsStmt 
Input : HtAti'ini’iit S : Thr statement inserted 
Output : The updatiMl dependences 

1 8ourc« - p 

2 V.s'T-. FuulDepl.V.A-, 5, \S.k% 5 ], V ) 

3 V Dt phi !s,sf Lt i source = source U Si 

4 For each S,a such that ({5, ^ S) kk {BDepRels,s,.x and Sit source)) 

5 '^DtpHt ls,Sj, r fi*!**!* that {Spt source) kk. {DepRels^s,.x crosses S) 

f» notCovered = notCovered U Range{Dcp/?e/sj,s,.x) 

7 If { Sj •4,. S ) 

8 IteginSliijt ~ 

9 FIm- 

10 heginStiiif “ last(’ommoiiLoop(5’,5'j) 

11 FiiHineplI.**;./. notCovered, beginStmt, source) 

12 Kudfur 


Figure 12; lnrreiiK*nla! algorithm for insertion of assignment statement 

source : The set <if all the source references of 5.1. 

notCovered : The set of value.s of the reference being updated. 

beginStnt : I he statement from which the source functions for the affected values 
is to he recomputed. 

'I'he source fimclions for the refe*rences in statement S are computed in statement 
2, and the set source is computed in statement 3. The references outside S that 

have dependences affected are found in 4. 

A reference outside 5 is considered to have its dependences affected if, one of its 
dependence is affected as a result of the increase in values generated. A dependence 
I>(:pR< ls,Sj.T is affected a.s a result of increase in the generated values if Si is source 
for some of the values of 5.1 (as in chapter 3), and the dependence crosses the 
statement 5. If the dependence does not cross the statement 5, there are no writes 
of 5.1 in between values of 5^.1 and Sj.w. Hence, the dependence is not affected. 

The values of Sj.x that become uncovered are computed in statement 5. If a 
dependence is affected, 'all the values of Sj.x in the dependence are considered to 
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brconie uncc>%’m*cl. I'his is a consprvaliw approximation to the values that become 
uncovered (as given in chapter 3). A reference Sj.x may have more than one such 
d<’|>e!idenc<*s affected, all such dependences affected are computed in statement 5. 
Ail the values of Sj.r in these dependences are added to notCovered in statement 
6 . 

The new sources for values in notCovered are computed in statements 7-11. 
Th«* new sources are computed by the function FindDepl. The function FindDepl 
is sijuiiar to fmiction FindDt p given in Appendix A. However, the difference between 
the two functions are, 

1. In function FindCoverSingleWrite, dependence from a source S, to Sj.x 
is compute<l only if the source is 5.1. For other writes, the range of old 
dependence /)e pfh ls,s,.x is restricted to the values in notCovered. 

I’hc dependence from tlie old sources need not be recomputed because, there 
is no decrea.s<* in the generated values by any statement. As a result, at 
any stage in tin* computing the source function, there are no new values of 
in tlje notCovered as compared to the exhaustive analysis. Hence, the 
d<*p<*n<lenc«*s from old staioments need not be recomputed. However, new 
values from 5M may remove some values in notCovered as compared to the 
exhaustive analysis. Hence, the old dependences are to be restricted to the 
values in notCovered. 

2. In the function FindCoverMultipleWrite only the dependences with new 
write as source are to be updated with the function RelMax^- The old de- 
pendences are already updated with the function RelMax^, hence need not 
be updated again. The function is given in the figure 13. 

The statement from which the search should start is found in statements 7-10. If 
Sj appears after S lexically, then there can be a loop independent dependence from 
5.1 to Sj.x hence, the search starts from statement 5. If the statement Sj appears 
before S lexically, then there can be no loop independent dependence from 5.1 to 
Sj,x. The search should start from finding the loop carried dependences carried by 
the last common loop between 5 and 5j. 
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F\inction FindCoverMultipleWrite(reference Sj.x, set possibleSources, DNF notCovered, 

Statement loop, Flag carriodFlag) 

1 cMax = 4> 

2 Forall writes St'.l such that Si c possibleSources fiii Si ^ statement inserted 

3 wrMax = wrMax U (DepRels,Si.x /^otCovitA) 

4 cMax = FindCoverSingleWrite(5j-.x, 5i.l, aotCovsrsd, 7„, carriedFlag) 

5 wrMax = RelMax^iy/tMax., cMax) 

6 Endfor 

7 return wrMax 

Figure 13: Function FindCovereMultipleWrite for Incremental Analysis 

Example : Consider the program given in figure 6(a). The dependences in the 
program are given in equation 2. Suppose a new statement, S 2 is added at the 
position indicated, the program is as shown in figure 6(b). The process of updating 
the dependences by the algorithm IncrAnalysisInsStmt is given below. 

The dependences for references 52.1 and S 2.2 are computed in statement 2. The 
dependences for these references are as in equation 3. The set source = { 5i.l, E}. 
The references outside S 2 , that have their dependence possibly affected as found in 
statement 4 are 53.I, ^4.! and Sz-2. 

Consider the case of reference 53.I . The dependence affected is only DepRelsiSa.i- 
The notCovered computed for the reference in statement 5 is 53.1[i, j] | 1 < i,j < 
20. Statement Sz appears after S 2 lexically hence, the beginStmt is Sz- The new 
sources for values in notCovered computed by the function FindDtpl are, 

ji] '?3-l[i2,i2] I 1 < *2,i2 < 20 A even{j 2 ) A ii = H A 2ji = 32 

5i.l[ii,ii] 53.1[i2,i2] I l<*2,i2<20 A odd{j 2 ) A 11=12 A h-32 

Similarly for the reference 54. 1, the dependence affected is DepRels 3 Si.l 1 and 
notCovered is 54.1[i, j] [ 1 < i,j < 20. The statement ^4 appears after S 2 hence, 
the beginStmt is 82 - The new sources for the values in notCovered computed by 
FindDepl are, 

‘S'3-l[*l,il] ‘S'4-l[*2,i2] 1 1 < *2,^2 < 20 A ii = 12 A ji = j2 

Similarly the new source functions for the reference 53.2 is 

*S'2-l[*i5ii] —* <53.2[i2,i2] I 1 ^ Hih < 20 A ii = (2 A ji =j 2 - 
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4.2 Deletion of Assignment Statement 


The deletion of an assignment statement say, S decreases the generated values in the 
program as given in chapter 3. The algorithm for incremental analysis on deletion 
of statement, IncrAnalysisDelStmt is given in figure 14. The process of updating 
dependences on deletion of assignment statement consists of the following steps, 

1. Find all the references outside S say, Sj.x such that the source for the reference 
is affected after the deletion of statement. 

2. Find the values of Sj.x for which the new source have to be recomputed. 

3. Compute the new sources for the values found in (2). 

First the references that are source for 5.1 are found in statement 2-4. Then 
the references affected as a result of decrease in the generated values is computed 
in statement 5. The dependences for a reference Sj.x is affected if one of its source 
is 5.1. The values of Sj.x that become uncovered are computed in statements 6-8. 
A value of Sj.x becomes uncovered if its source is 5.1. The variable notCovered 
contains the values of Sj.x which are uncovered. 

The new sources for the values in notCovered are computed in statements 9-11. 
The possible new sources for the values of Sj.x in notCovered are the references 
in source. The new dependences are computed by the function FindDep. The 
dependences of Sj.x not crossing statement 5 are not affected. Hence, the search 
for dependence is to be started from the statement preceding S. 

Example : Consider the program in figure 6(b), the dependences in the program 
are given in equation 4. The process of updating the dependences by the algorithm 
IncrAnalysisDelStmt on deletion of the statement S 3 is given below. 

The set source computed in the statements 2-4 is {5i.l, 52.1 }. 54.1 is the 
only reference which has 53 . 1 as its source. The notCovered for this reference is 
54.1[i,y] I 1 < i,j < 20. The search for the new source functions begins from 
dependence covered by Entry, the last common loop between the statements S 4 and 
S3. The dependences computed by the function FindDep axe 

52.1[ei,;i] 54.1[t2,j2] I 1 < * 2,^2 < 20 A even{j 2 ) A ii = 12 A 2ji = j 2 
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Algorithm IncrAnalysisDelStmt 
Input : Statement S : The statement deleted 
Output: The updated dependences 
source = ^ 

For all references SiA such that there is dependence DepRelsiS.i- 
source = source U Si 
Endfor 

For all references 5,-.ar such that DepRelsSiJc A S{ ^ S 
For all dependences such that DepRelsSi.x 

notCovered = notCovered U Jiaiige{DepRelss,.x) 

Endfor 

beginLoop = lastCommonLoop( S',-, 5 ) 
beginStmt = PrecStmt( S ) 

newDeps = FindDep{ Si-x, notCovered, beginStmt, source ) 
Endfor 


Figure 14: Incremental algorithm for deletion of an assignment statement 
->54.1[i2,;2] I I<t2,i2<20 A odd{j2) A ii = ii A ji = j2 

4.3 Insertion of loop 

The insertion of a loop may cause both decrease and increase in the data generated as 
well as the values read as given in cliapter 3. The algorithm IncrAnalysislnsLoop, 
given in figure 15 updates the dependences on insertion of a loop. In the algorithm 
the updating for increase and decrease in the generated values are combined together. 
The procedure of updating the dependences after insertion of a loop say, I is, 

1. Find the source functions for all the references inside /. 

2. Find the references outside I say Sj.x such that the source function of Sj.x are 
affected. 

3. Find the values of Sj.x that become uncovered after insertion of 1. Compute 
values affected both for increase and decrease in the generated values. 

4. Compute the souce functions for the values that become uncovered. 
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The variables used in the algorithm are 

oldSource : Array of sets containing the old source references for the writes inside 
loop inserted. 

newSource : Array of sets containing the new source references for the writes 
inside loop inserted. 

possibleSources : The set of references that are possible source for the references 
affected. 

The source functions for the references inside the loop I are computed in state- 
ments 2-8. The sets oldSource and newSource are are used for updating depen- 
dences as in the cases of increase/decrease in the generated values respectively. 

There is change in the values generated by the writes inside only the loop 1. The 
source for a reference outside I is affected as a result of decrease in the generated 
values if it has a source inside /. The new source for the values affected are the 
references in set oldSource. The source for a reference is affected as a result of 
increase in the generated values if its source is in set newSource. The new source 
for the reference can be the writes inside the loop 1. A reference outside /, for 
which the dependence affected is to be updated for both increase and decrease in 
the values generated. Instead, the updates for both of these are combined together 
and updated in function UpdatelnsLoop. 

Let the references affected be S.x. The dependences affected for the reference S.x, 
and the values affected are computed in statement 13. A dependence DepRelsiS.x 
for S.x is affected if it crosses the loop inserted I and the source is in set source 
or set newSource. This corresponds to the decrease and the increase of the values 
generated respectively. If a dependence DepRelsiS.x is affected, all the values of 
5.ar[i,s] in the dependence DepRels^s.x become uncovered. The new sources for the 
values in notCovered are computed by the function FindDep. The possible sources 
for the values in notCovered are the references in set possibleSources. The vari- 
able beginStmt contains the statement from which the search for new dependence 
should start. The beginStmt is, 

# the head of the last common loop between S and 1, if S head of loop 1. 
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Algorithm IncrAnalysisInsLoop 
Input : Loop 1 : The loop inserted. 

Output : The updated dependences after the insertion of the loop 

1 navSource = oldSourcas = possibleSources^ ^ 

2 For all references S.x inside the loop 1 

3 If reference S.x is a write 

4 oldSource( S.x ) = oldSource(S.x) U (Si such that DepRels.s x) 

5 Endif 

6 DepRels.x = FindDep( 5.a:,5,[S'.x,s],[/ ) 

7 If reference S.x is a write 

8 newSource( S.x ) = newSource(S.x) U 5,- such that DepRels.s.x^^^pR'^h.x 

9 possibleSources = possibleSources U newSource(S.x) U oldSoiirce(S.x) U S 

10 Endif 

11 Endfor 

12 VSj.x outside / such that (BDcpRels.Sj.x A (5,- inside / V 5,c newSource)) 

13 l)pdateInsLoop( 5j.x, 1, possibleSources ) 

Function UpdateInsLoop( reference S.x ) 

14 notCovered = <l> 

15 ^DepRels.s.x such that (DepRels^s.x crosses I A (5i inside I V S,c newSource)) 

16 notCovered = notCovered U Kaxige{DepRels^$.x) 

17 /n = lastCommonLoop( S.x, 1 ) 

18 If S.x < 1 

19 beginStmt = For statement of In 

20 else 

21 beginStmt = Endfor of loop Ik such that /jt covers 1 and depth(/jb) = depth(/„) -f 1 

22 Endif 

23 FindDep( S.x, beginStmt, notCovered, source ) 


Figure 15: Incremental algorithm for insertion of do loop 

• the Endfor of the loop 4? where Ik covers / and if 4 is the last common loop 
between S and /, depth of 4 is depth(/n) + 1. 

It can be noted that in the exhaustive analysis algorithm, the dependences crossing 
/ are computed after the search reaches the statement in beginStmt. 

Example : Consider the program given in figure 9(a), the. dependences in the 
program are given in equation 5. If a new loop is added as shown in figure 9(b), 
all the references to variable j in the statements S 4 and Ss become references to 
the index j. The process of updating the dependences from the algorithm is given 
below. 
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The old dependences for the writes inside the loop is given in equation 5. The 
set oldSource is {51.1,52.1,53.1}. The new dependences for the writes inside the 
loop, 53.1 and 54 . 1 are. 


'^i'l[ti,Ji, -* 54 . 1 ( 12 ,^ 25 ^ 2 ] 

1 1 < *2 < 20 A 2 < j2 < 20 A 1 < ^2 < 10 A 

*1 = *2 A ji = j2 A ki= 2k2 

‘5'2-l[ei,7i, A:i] — + 54.1[?2,i25M 

1 1 < 22 < 20 A 2 < j2 < 20 A 11 < ib2 < 20 A 

*1 = *2 A ji = j 2 A fci = *2 

■^’i-l{?i,Ji, i'l] 53.1 [r2, ^25 ^' 2 ] 

1 1 < *25 ^*2 < 20 A odd(k2) 2 < j2 < 20 A 

*1 = *2 A ji = j2 A ki = k2 

54-l[zi,ji, A'l] -4 53 . 1 ( 2 : 2 , >2, N 

1 1 < *25 k2 < 20 A even{k2) 2 < ^2 < 20 A 

*1 = *2 A ji = j2 A 2ki = k2 


The set newSource is {53, 52, 5i} and the reference outside the loop 1 that is to be 
updated is only 55 .I. 

The algorithm UpdatelnsLoop calculates the new dependences for the reference 
55 . 1 . The dependences affected for the reference are DepRelsiSi.i and DepRels^Ss-i • 
The variable notCovered is 55.1[i,j, /:] | 1 < iij,k < 20. The reference 55 . 1 is 
lexically after the loop /. The last common loop between the S 4 and I 2 is Entry. 
The depth of Entry is taken as 0. The loop covering I 2 and at depth 1 is fi. Hence, 
the search starts from Endfor statement of the loop li. The dependences for the 
reference is, 

‘53-1 All] — > 55.l[i2, j25^2] I 1 < *2,^2 <20 A 2 < j2 < 20 A = *2 A 

ii = h A fci = ^2 

Si-l[ii,ji,ky] Ss.l[i2,j2,k2] I 1 <*2,^2 <20 A ;2 = 1 A = Z2 A 

ji = j2 ^ ki =k2 


4.4 Deletion of loop 

Deletion of a loop, say /, may cause both increase and decrease of the data 
generated. The incremental analysis on deletion of a loop is done by the algorithm 
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Algorithm IncrAnalysisDelLoop 
Input : Loop 1 : The loop deleted. 

Output : The updated dependences after the deletion of the loop 

1 newSource = oldSources = possibleSources= <l> 

2 V5.r such that S inside / and x ^ 1 

FindDep(5.x, S, [5.x, s], U) 

3 For all references 5.x inside the loop 1 such that x = 1 

4 oldSource( S.x ) = oldSource(S.x) U (5,- such that DepRels^s.r) 

5 DcpRels.x = FindDep( 5.x,5,[5.x,s],(/ ) 

6 newSource( S.x ) = newSource(S.x) U 5,- such that DepRcls,s.x^D€pRels,r 

7 possibleSources = possibleSources U iiewSource(S.x) U oldSource(S.x) U S 

8 Endfor 

9 V5j.x outside / such that {3D€pRels,Sj.T A (5,- inside / V Sit newSource)) 

10 UpdateDelLoop( Sj.x, 1, possibleSources ) 

Algorithm UpdateDelLoop(reference S.x, loop 1, set source) 

11 notCovered = NULL 

12 ^DepRelsiS.x such that DepRels,s.x I 

notCovered = notCovered U Range(DepjRe/ 5 ,s) 

13 commonLoop = lastCommonLoop(5.x,/ ) 

14 IfS.x<l 

15 beginStmt = common Loop (5.x,/) 

16 Else 

17 If (5 and / are inside same loop) 

18 beginStmt = Statement, preceding Endfor of the loop / 

19 Else 

20 beginStmt = Endfor of loop h such that /* covers 1 and depth(/jfc) = depth(/n) + 1 

21 Endif 

22 Endif 

23 FindDep( S.x, beginStmt, notCovered, source ) 


Figure 16: Incremental algorithm for deletion of do loop 
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IncrAnalysisDelLoop given in figure 15. The dependences of a reference affected, 
arc to be updated for both increase and decrease in the values generated. Instead, 
both the analysis are combined in the algorithm. 

The functionalities of algorithms, IncrAnalysisInsLoop and IncrAnalysisDelLoop 
are similar. They differ only in the calculation of beginStmt in function UpdateDel- 
Loop. The variable beginStmt is computed as, 

• the hear! of the last common loop between S and 1, if S <C head of loop 1. 

• the statement preceding Endfor of I if, both S and I are inside the same loop. 

• the Endfor of the loop 4, where 4 covers 1 and if /„ is the last common loop 
between S and f, depth of Ik is depth(/n) + 1- 

Example : Consider the program given in figure 9(b). If the loop I 2 is deleted, 
the program is as given in figure 9(a). The process of updating the dependences on 
deletion of I 2 is given below. 

The dependences of the references inside the loop I 2 before the deletion of the 
loop are, 

■S^4.1[*i jiij ^ 1 ] ^ 2 ] I l^f25^2^20 A even{k2) A 2 < j2 ^ 20 A 

i\ = ^2 A ji = J2 2/?] = k2 

iSi.l[?i,yi, fci] 5'3.1[t25 J 2 i ^' 2 ] 1 1 ^ *2i ^2 ^ 20 A odd[k2'} 2 ^ j2 ^ 20 A 

=12 Aji = j2 A ki = k2 

^x] 54.1[i2,;2, * 2 ] 1 1 < *2 < 20 A 2 < j2 < 20 A 1 < ^2 < 10 A 

*1 = *2 A ji = j2 A A:i = 2fc2 

52.l[*l,jl,fci] ^ 54.l[i2,j2,it2] 1 1 < i2 < 20 A 2 < i2 < 20 A 11 < fc2 < 20 A 

*1 = *2 A ii = j2 A ki = ^2 

The set oldSource = {Si , 52,53}. The new dependences for the references after the 
deletion of loop I are, 

54.1[ii,fci] 53.1[t2,^-2] I 1 < i 2 ,h < 20 A even{k 2 ) A h = h A 2fci = fcj 

5i.l[t'x, 53 . 1 ( 12 , ^ 2 ] I 1 < * 2,^2 < 20 A odd{k 2 ) A = h A ji = 1 
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fc ] — ^'2 

‘?4-l[t2,^2] I 1 < *2 < 20 A 1 < ;fc2 < 10 A ;, = 1 A 
I'l = *2 A fci = 2^2 

52-l[*l,il, ^l] — ^ '?4-l[*2,^2] I 1 < t2 < 20 A j’l = 1 A 11 < A:2 < 20 A 

ii = ^2 A ki = k2 

The set newSource = {5i,52,S3}. Ss-l is the only reference outside the loop 
1 that has its dependence affected. Its dependences are updated by the algorithm 
UpdatcDelLoop. The lastStatement for the deleted loop I 2 is the Endfor statement 
of the loop /g. The notCovered for the reference S 5 is ^s-lfi,;, fc] | 1 < hj^k < 20. 
I'he start statement is the Endfor statement of the last common loop between S 5 and 
I 2 , i.e Endfor of loop /j. The new source functions for the reference 55.1, calculated 
by the function FmdDep are, 

53.1[fi,A:i] —* 55.1[i2,i25 ^ 2 ] I 1 ^ *25^2 < 20 A J2 = 1 A = 22 A k\ = k2 
‘S'i.l[2i,ii, ki] Ss.l[i 2 ,j 2 , M I 1 ^ * 2 , 1:2 < 20 A 2 < ;2 < 20 A ii = 22 A 

jl — ji A jfci = ^2 
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Chapter 5 
Results 


In this chapter we will present the timings for incremental analysis done by using the 
algorithms given in chapter 4, as compared to the timings for exhaustive analysis. 

The timings are taken for 6 programs, each of about 50 lines from NASA NAS 
benchmark programs provided with the tiny tool. In the graphs given below, the 
fraction of incremental analysis time over exhaustive analysis time is given in the 
X-axis. The fractions are rounded to nearest multiple of 0.05. Y-axis contains 
the percentage of cases that gave the speedup. We present some of the interesting 
observations corresponding to the speedups obtained. 

5.1 Insertion of assignment statmenent 

The time for incremental analysis on insertion of an assignment statement is 0.02 
to 0.2 times that of exhaustive analysis time, as given in the graph below. 

Insertion of an assignment statement, say S affects the dependences correspond- 
ing to the variable Arr(5.1). Dependences involving other variables are not affected. 
In programs that use many variables, the incremental analysis, on average, takes 
much lesser time than the time for exhaustive analysis. 

Consider a statement is inserted such that, it overwrites values written by E. 
That is, it is first write to some memory locations in the program. The possible 
source for the affected references are the write inserted and the Entry only. Hence, 
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the search space is vary small and the speedup is more. 



5.2 Deletion of assignment statement 

The time for incremental analysis on deletion of an assignment statement is 0.02 to 
0.25 times that of exhaustive analysis as given in the graph below. 

Deletion of an assignment statement S affects the dependences corresponding 
to the variable Arr(5.1). In programs that use many variables, the incremental 
analysis, on average, takes much lesser time than the time for exhaustive analysis. 

If a write having less number of source references is deleted, the search space for 
the sink references is very small. In such cases, the incremental analysis is expected 
to give significant speed ups. In particular if the source of the deleted write is only 
the Entry, the speedup is very significant as no dependence testing is needed. 


49 





5.3 Insertion/Deletion of loop 

The time for incremental analysis on insertion of an assignment statement is 0.05 to 
0.95 times the exhaustive analysis time. For majority of the cases the incremental 
analysis time is 0.1 to 0.25 times the exhaustive analysis time. 

In most of the cases, the percentage of assignment statements inside the loop 
compared to those in the program is 10 to 30%. In such cases, the time for in- 
cremental analysis is 0.1 to 0.4 times the exhaustive analysis time. In cases where 
the percentage of assignment statements in the loop is more than 40%, the time for 
incremental analysis also increases. If percentage of assignment statements inside 
the loop is more than about 80%, the time for incremental analysis is almost equal 
to exhaustive analysis. This is because insertion/deletion of such loops affects al- 
most all the references inside the program. Hence, all the dependences have to be 
recomputed. 
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Chapter 6 
Conclusion 


In this work, the incremental dependence analysis for value based dependence has 
been presented. We have shown how the dependences change as a result of arbitrary 
increase or the decrease in the values written or read in a program. 

We have shown how incremental analysis for addition and deletion of assign- 
ment statements, and for loops can be formulated as increase/decrease in the values 
generated. The algorithms for insertion and deletion of assignment statements and 
loops have been presented. The approach for incremental analysis is general enough 
for other form modifications in a straight-forward w'ay. 

6.1 Future Directions 

• The algorithms developed are for single modifications. An interesting problem 
to investigate would be to find how the dependences are affected as a result 
of multiple modifications. We claim that updates in these cases can be done 
similar to insertion/deletion of loops and we have addressed most of the issues. 

• We have given algorithms for insertion/deletion of assignment statements and 
loops. This can be extended to other type of modifications also. 

• The work address incrementalism in analysis procedure. An orthogonal view 
would be to incrementalize the dependence testing. This is an interesting 
problem to investigate. 
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• Our implementation is over the UMCP version of Tiny tool. The tool was 
not developed for incremental analysis and hence many overheads are present. 
A complete implementation with incremental analysis as goal may produce 
better results in some cases. 

• The semantics defined on the index variable of the loop plays an important 
role in values generated after the insertion/deletion of a loop. For example, if 
the index variable is after the execution of the loop the value of i may be, 

the value of i in the last iteration of the loop or 

an undefined value or 

any value that the index i took. A comparative study of the performances 
is an important issue in practical cases. 
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Appendix A 

Exhaustive Value Based 
Dependence Analysis 

A.l Lazy Array Data-Flow Dependence Analysis 

The value based dependence for a reference Si.k, such that Si.k is sink is defined 
symbolically as, 

Vr,s : (5'i[u,s] ^ Si.k[r,s])eDepRels,Si.k ^ 
max<(5'[u;,s] | it>€[S,s] A s] A Arr(S.l) = Arr{Si.k) A 5[u>,s] <C 5'i.A:[r, s]) 

Vadim Maslov [7] proposed a procedure to compute source functions, DepRelsi.k, 
for a reference Si.k based on the definition given above definition. The procedure 
is called “Lazy Array Data-Flow Analysis The procedure can be considered as 
a search for the most recent hits to the memory locations referred to by values 
of Si.k. It takes advantage of the fact that the most recent hit is the first one 
encountered while moving backward in the iteration space. If /„ is the innermost 
loop covering statement Si.k, first the loop independent dependences carried by 
loop In are computed. If source for some values of Si.k are not yet computed, the 
dependences carried by l„ are computed. Then the process is repeated for next 
higher loop say /„_i and so on. This process is repeated till the source for all the 
values of Sj.k are computed or all the possible writes are considered. If for some 
values there are no sources, they are made to be dependent on Entry. 
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The algorithm FindDep given in figure 17 is a modified form of the algorithm 
given in [7]. The original algorithm is modified to accept different inputs. 

The variables used in the algorithm are, 

Sj.T : The reference for which the source functions are to be computed. 

notCovered : Contains the values of reference Sj.x for which the source are to be 
computed. For exhaustive analysis, notCovered = s]. 

startStmt : Contains the statement from w'hich the search for dependence is to 
be started. For exhaustive analysis startStmt = Sj. 

source : A set consisting of the references w'hich can be source for Sj.x. For 
exhaustive analysis source = U, the universal set. 

DepRel : Contains the dependence relations computed in the algorithm. 

cMax : When there axe more then one possible writes, this contains the dependence 
from a single source. 

possibleSources : The set of references that can be sources for values in notCovered 

The search for the sources start from the statement beginStmt, and depLoop is 
set to the loop covering statement R. The search moves backwards lexically. If the 
statement reached is a 

an assignment statement Si: The dependence from 5,- to Si-k is computed (as in 
statement 11). 

a do statement : The search is crossing the loop boundary, a values generated 
in the previous iterations of the loop /„ may be the source. Hence, the loop 
carried dependences from the writes inside I are computed as in statement 20 
by the function FindCoverMultiple Write. 

an Enddo of loop /„: The search is entering into a loop hence the loop inde- 
pendent dependences from all statements inside /„ are to be computed as in 
statement 20. 
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Entry There is no write to the memory locations of values in notCovered. Hence, 
they arc made dependent on Entry. 

Example: Consider the program given in figure 18. The process of finding the 
dependence for the reference S'!-! i.e, write XRISQ{i,q) in statement Si, by the 
algorithm is given below. 

The variable notCovered contains all the values generated by the reference. The 
values in notCovered are, 

q,i) I 1 < rs < nrs Al<p<npAl < 9 <pAl<?’< mb. 

This is an exhaustive analysis hence, the variable beginStmt = ^i. First the loop 
independent dependences carried by the loop I 3 are computed. There is no write 
inside the loop preceding statement Si and hence no loop independent dependence 
carried by I 3 . 

The statement preceding Si is the Do statement of the loop I 3 . The search is 
crossing loop I 3 and hence the loop carried dependences carried by I 3 , are to be 
computed. The flag carriedFlag is set to TRUE. The possible writes are S 2 and 
5i. The dependences from these writes is computed by the function FindCoverSin- 
gle Write in statement 11. There is no loop carried dependence carried by from 
52.1 to 5i.l and from 5i.l to 52-1. 

The statement preceding Do of I 3 is Do of loop Hence, the dependences 
carried by I 2 are computed in statements 15-20. The possible sources axe S 2 and 5i. 
There is no dependence from 5i.l to 5i.l carried by loop I 2 . The dependence from 
52-1 to 5i.l carried by loop I 2 is, 

‘?2bb9i>*i] ‘5'ib2>92,i2] I 2 <p 2 =q 2 <npM <i2<mb A 

Pi =P 2 A ^1 = 92 - 1 A *1 = *2 


The values in of 5i.l in Range(Z)epRe; 52 Si) is removed from notCovered in 
statement 26. The resulting notCovered is 

5i.lbi 9, *1 I (p = q=lAl<i< mb) V(1 <q<p<npAl<i< mb) 
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Algorithm FindDep 
INPUT : 

Reference Sj,x : The reference for which the dependence is to be found 
such that its the sink. 

DNF notCovered : The values for which the dependences are to be found 
Statement startStmt : The statement from which the search starts 
Set source : The set of statements which are possible sources 
OUTPUT : 

Dependence Relations DepRels^.x 

1 Relation DepRel = (j> 

2 Statement loop = CoveringLoop( Sj.x ) 

4 Boolean carriedFlag = FALSE 

5 Statement S = startStmt 

6 While (notCovered is feasible) do 

7 S = statement preceding S 

8 wrMax = <j> 

9 Switch (type of statement S) 

10 case assignment statement 

11 wrMax = FindCoverSingIeWrite(Sj.x, notCovered, lastCommonLoop(S,Sj), FALS 

12 break; 

13 case Do of loop 

14 case Enddo of loop In 

15 If (5 is Do statement) 

16 carriedFlag = TRUE 

17 Else 

18 carriedFlag = FALSE 

19 possibleSources = j Si inside and Si € source} 

20 wrMax = FindCoverMultipleWrite(5j .x, possibleSources, notCovered, /n, carriedFlag) 

21 break; 

22 case Entry 

23 wrMax = DepRel U { Entry Sj.x[ii,s] | Sj.x[ii,$] e notCovered } 

24 break 

25 Endswitch 

26 notCovered = notCovered — Range(wrMax) 

27 DepRel = DepRel U wrMax 

28 Endwhile 

29 return DepRel 


Function FindCoverMultipleWrite(Reference Sj.x, set possibleSources, DNF notCovered, 

Statement loop, Flag carriedFlag) 

30 cMax = 

31 Forall writes 5».l such that Si e possibleSources 

32 cMax = FindCoverSingleWrite(5j .X, 5i.l, notCovered, /„, carriedFlag) 

33 wrMax = i?e/Max 2 (wrMax, cMax) 

33 Endfor 

34 return wrMax 


Figure 17: Algorithm for Ex^ustive Dependence Analysis 
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Do q = 1 , np 
Do i = I, mb 

XRSIQii,q) = 0 
Enddo 
Enddo 
Do p = 1 , np 
Do 9 = l,p 
Do i = l,rr?6 

XRSIQiuq) = XRSIQ{i,q)-\- ... 
XRSIQ{i,p) = XRSIQ{i,p)+ ... 
Enddo 
Enddo 


Figure 18: Code from subroutine OLDA from TRFD 

Then the dependences carried by loop /j is found. The dependences from state- 
ments $2 and Si are, 

S2\pi,quH] -* 5i[p2,92,f2] I 1 < 92 <P 2 < np A 1 < l 2 < m 6 A 

Pi = 9i = 92 A ii = 12 

Si\puqi,ii] -4 5 i[p 2 , 92 ,f 2 ] I 1 < 92 <P 2 < np A 1 < i 2 < mb A 

Pi = P2 - 1 A 9i = 92 A ii = 22 

The lexicographical maximum of these two candidate writes is found by 
RelMax 2 in statement 21. The resulting dependences are, 

52bi>9i,*i] 5i[p2,92,*2] I 2 <P 2 < npA92 = P 2 -lAl <22 <nz 6 A 

Pi = P2 - 1 A Pi = P2 A 2i = 22 

Sibi » 9i) ^i] — * Si [p 2 , 92 ? * 2 ] I P 2 ^ np A 1 < 92 ^ P 2 ~ 2 A 1 <22 < mb 

Pi = P 2 - 1 A 9i = 92 A 2 i = 22 

The values covered by these dependences are removed from the notCovered, the 
resulting notCovered is, 

Si\p,q,i] I (p = 9 = 1 A 1 < 2 < mb). 
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I'hc search moves backwards, and reaches the Enddo of the loop /j. The only 
write inside the loop /j is So, the dependence covered by /i from to Si is computed. 
This is the only candidate write, and the dependences for the values in notCovered 
are, 

Si[quii] -* Si\p2,q2,i2] I P 2 = 92 = 1 A 1 < < m6 A qi = P2 A h = *2 

The values covered in this dependence are removed from the notCovered. The 
notCovered results to aJid the search stops. 
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